Repository navigation
usertest: sample data for sessions without a provider account (#196) - #239
Merged
Merged
Conversation
Money: synthetic Acme Studio bank statements (MT940 Aug, overlapping MT940 Sep, camt.053 Aug) generated in integrations/money/fixtures/usertest/, served from the catalog host's samples/money/ and linked on the session page; money.md uses them first. Calendar, GitHub issues, Clockify and Notion: catalog.mjs builds a "<App> (sample data)" entry per app, the same built app with store.proxy answered in the frame by the mock proxy's provider fixture, already connected, with writes persisted under the App and replayed on remount. New -sample session plans say the data is invented so the analysis does not log it as a finding. Checks: money vitest for the statements, node --test for the sample accounts, usertest/e2e/samples.mjs against the pinned atomic-server, and run.mjs for the page's sample-file links. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Qt6FnBHXdJWx9GEKuAqVBo
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #196.
A tester can now try Money, Google Calendar, GitHub issues, Clockify and Notion in a moderated session without a real account. Everything they see is invented. None of the apps' source changes, so
VERSIONSis unchanged: a freshcatalog.mjsbuild gives byte-identical modules for all five existing apps, compared againstorigin/main'scatalog.mjs.The design, and why
Money needs no account, only a file, so it gets the sample statements #196 asked for:
integrations/money/fixtures/usertest/generate.mjswrites three files for Acme Studio, accountNL00BANK0000000000, with invented counterparties:acme-studio-2026-08.mt940: 1 Aug – 15 Sep, 31 bookings.acme-studio-2026-08.camt053.xml: the same bookings, plus a pending entry that is not imported.acme-studio-2026-09.mt940: 1 – 30 Sep, 25 bookings. Ten of them overlap the first file by bank reference, so 15 are new.catalog.mjscopies the files tosamples/money/on the catalog host. Caddy serves/samples/*as an attachment.Sample filesline names its files. The moderator lists them with/plans, and the session page shows them in a "Sample files" card, before and during the session.money.mdnow offers the sample first, and the tester's own export only as an option. The privacy question is gone from the first turn.For the OAuth providers, the smallest fit was the mock proxy's existing stateful fixtures. These are the same ones the lanes' e2e tests run against.
catalog.mjsbuilds a second entry per app: "Google Calendar (sample data)", "GitHub issues (sample data)", "Clockify timesheets (sample data)" and "Notion (sample data)".usertest/sample-data/proxy.mjs. Onlystore.proxyis replaced, by the fixture running in the app's frame. The drive, rows, row access and review steps are the real host's.acme-studio/*repositories (the existinguser-testingscenario), Alex Sample's Clockify fortnight, and Notion's Roadmap and Reading list.Datefixed at each write's original time, so ETags and timestamps come out identical.calendar-sample,issue-tracker-sample,timesheets-sample,notion-sample) say in "For the moderator only" that the data is invented. So "no sign-in", "not my data" or "couldn't open it on GitHub" are expected, not findings.sessions/README.mdexplains when to use them.I did not seed the test drive server-side and did not add a mode to the apps. Either would need app or host changes, and the host is frozen. This approach needs neither.
Checks run (2026-10-01, pin
a12b74a6783b)node usertest/e2e/samples.mjs: 4/4. It builds the catalog, serves it, and starts the pinned atomic-server. Then it opens/app/dev-drivethe way the page does, installs each "(sample data)" entry from Integrations, imports, finds an invented record, reloads, and finds it again.node --test usertest/sample-data/samples.test.mjs: 6/6. Covers reads, writes, and replay after a remount: calendar PATCH and ETag, a stale If-Match that still gets 412, GitHub create and close with identical dates, and a Clockify PUT.node usertest/e2e/run.mjs: 19/19. The new check: money's sample links, none for notion, and the card stays visible during the session.vitestfor money: 175/175, including the newusertest-samples.test.ts. The files match their generator, both readers parse and reconcile them, and the overlap gives 15 new identities.oxlintandoxfmt --checkonintegrationsare clean.caddy validatepasses with Caddy 2.6.2, the version the droplet runs.check-live.mjscould not reach the droplet from the cloud session (HTTP 403 from the proxy).Lanes
None of the existing lanes covers this. The sample wrapper lives in
usertest/, andlanes.mjslets a tooling lane name only paths underintegrations/tooling/, so I added no lane. The real-host check isusertest/e2e/samples.mjs. Likerun.mjs, it is not in CI. Money's new vitest does run in CI, through money's certification step.Not covered / known limits
-sampleplans and a real account still cover that. Links to provider pages ("Open in Notion", an issue's GitHub page) lead nowhere.controller.connect()doesn't calllistRepositories(). The Notion app likewise doesn't start its first sync on that path. I found this while building the fake proxy, worked around it with "starts connected", and left the apps alone.-sampleplan covers the no-account case in the meantime.Deploy needs (for Michiel or the usertest-deploy workflow)
Rows from
docs/agents/usertest-droplet.md:catalog.mjs→check-live.mjs→deploy.sh. This brings the new catalog entries,samples/, the page and the Caddyfile.deploy.shrestarts Caddy itself, and now also shipssamples.moderator/run.sh): the plans changed andserver.mjsnow lists sample files. This ends sessions in progress, so warn on Agent coordination board (Claude sessions: rules, status, hand-offs) #227 first.VERSIONSbumps.🤖 Generated with Claude Code
https://claude.ai/code/session_01Qt6FnBHXdJWx9GEKuAqVBo
Generated by Claude Code